FRAME ANALYSIS AND APPROXIMATION IN 
REPRODUCING KERNEL HILBERT SPACES 



PALLE E. T. JORGENSEN 

Abstract. We consider frames F in a given Hilbert space, and we show that 
every F may be obtained in a constructive way from a reproducing kernel 
and an orthonormal basis in an ambient Hilbert space. The construction is 
operator-theoretic, building on a geometric formula for the analysis operator 
defined from F. Our focus is on the infinite-dimensional case where a priori 
estimates play a central role, and we extend a number of results which are 
known so far only in finite dimensions. We further show how this approach 
may be used both in constructing useful frames in analysis and in applications, 
and in understanding their geometry and their symmetries. 



1. Introduction 

Frames are redundant bases which turn out in certain applications to be more 
flexible than the better known orthonormal bases (ONBs) in Hilbert space. The 
frames allow for more symmetries than ONBs do, especially in the context of signal 
analysis, and of wavelet constructions; see, e.g., [CoDaOS, BDP05, Dut06 . Since 
frame bases (although containing redundancies) still allow for efficient algorithms, 
they have found many applications, even in finite dimensions; see, for example, 
|BeFi03l l^aHflOal [Chr03 Eld02, FJKO05, VaWa05,. 

As is well known, when a vector / in a Hilbert space Ti. is expanded in an or- 
thonormal basis B, there is then automatically an associated Parseval identity. In 
physical terms, this identity typically reflects a stability feature of a decomposition 
based on the chosen ONB B. Specifically, Parseval's identity reflects a conserved 
quantity for a problem at hand, for example, energy conservation in quantum me- 
chanics. 

The theory of frames (see Definitions 16. II) begins with the observation that there 
are useful vector systems which are in fact not ONBs but for which a Parseval 
formula still holds. In fact, in applications it is important to go beyond ONBs. 
While this viewpoint originated in signal processing (in connection with frequency 
bands, aliasing, and filters), the subject of frames appears now to be of independent 
interest in mathematics. 

On occasion, we may have a system of vectors S inli. for which Parseval's identity 
is still satisfied, but such that a generalized Parseval's identity might only hold up 
to a fixed constant c of scale. (For example, in sampling theory, a scale might be 
introduced as a result of "oversampling" .) In this case, we say that the constant 
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c scales the expansion. Suppose a system of vectors S in a given Hilbert space Ti. 
allows for an expansion, or decomposition of every / in Ti., but the analogue of 
Parseval's identity holds only up to a fixed constant c of scale. In that case, we 
say that S* is a tight frame with frame constant c. So the special case c = 1 is the 
case of a Parseval frame. For precise definitions of these terms, we refer to Section 
121 below, or to the book literature, e.g., [ChrOSj . 

Aside from applications, at least three of the other motivations for frame the- 
ory come from: (1) wavelets, e.g., |CoDa93j . |BJMP05j . and |BJMP06| : (2) from 
non-harmonic Fourier expansions |DuSc52] : and (3) from computations with poly- 
nomials in several variables, and their generalized orthogonality relations Du XuOlj ■ 

While frames already have impressive uses in signal processing (see, e.g., 
|ALTWn4l IChr9 9' ) . they have recently |CCLVn5IICKL04j been shown to be central 
in our understanding of a fundamental question in operator algebras, the Kadison- 
Singer conjecture. We refer the reader to [CFTWOH) for up-to-date research, and 
to |(]hr99l IKaHiOTl INel57l INel59| for background. 

In all these cases, the authors work with recursive algorithms, and the issue of 
stability plays a crucial role. Stability, however, may obtain in situations that are 
much more general than the context of traditional ONBs, or even tight frames. In 
fact, stability may apply even when we have only a priori estimates, as opposed to 
identities: for example, when the scaled version of Parseval's identity is replaced 
with a pair of estimates, a fixed lower bound and an upper bound; see 1)6. l|l below. 
If such bounds exist, they are called lower and upper frame bounds. 

If a system S of vectors in a Hilbert space Ti. satisfies such a pair of a priori 
estimates, we say that S is simply a frame. And if such an estimate holds only with 
an a priori upper bound, we say that S* is a Bessel sequence. It is known (see, e.g., 
lAkCmap that for a fixed Hilbert space Ti, the various classes of frames S* in may 
be obtained from some ambient Hilbert space /C and an orthonormal basis B m )C, 
i.e., when the pair {S, Ti) is given, there are choices of /C such that the frame S may 
be obtained from applying a certain bounded operator T to a suitable ONB B in K.. 
Passing from the given structure in Ti to the ambient Hilbert space is called dilation 
in operator theory. The properties of the operator T which does the job depend on 
the particular frame in question. For example, if 5 is a Parseval frame, then T will 
be a projection of the ambient Hilbert space K, onto Ti. But this operator-theoretic 
approach to frame theory has been hampered by the fact that the ambient Hilbert 
space is often an elusive abstraction. Starting with a frame S in a fixed Hilbert 
space Ti, then by dilation, or extension, we pass to an ambient Hilbert space /C. 
In this paper we make concrete the selection of the "magic" operator T: /C — > 
which maps an ONB in JC onto S. While existence is already known, the building 
of a dilation system (/C, T, ONB) is often rather non-constructive, and the various 
methods for getting IC are fraught with choices that are not unique. 

Nonetheless, it was shown recently |Dut04bl IDut06| that when the dilation ap- 
proach is applied to Parseval frames of wavelets in Ti = L^(]R), i.e., to wavelet bases 
which are not ONBs, then the ambient Hilbert space IC can be made completely 
explicit, and the constructions are algorithmic. Moreover, the "inflated" ONB in K, 
then takes the form of a traditional ONB- wavelet basis, a so-called "super- wavelet" . 
For details, see BDP05, Dut04b . and also the papers rKoLa04, BJMP 05, BJMPO^. 

It is the purpose of the present paper to show that the techniques which work well 
in this restricted context, "super-wavelets" and redundant wavelet frames, apply to 
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a more general and geometric context, one which is motivated in turn by extension 
principles in probabihty theory; see, e.g., |PaSc72| . |Diitn4aj . and |,Tor06j . 

A key idea in our present approach is the use of reproducing Hilbert spaces, and 
their reproducing kernels in the sense of |Aro50| . See also |Nel57l INel59| for an 
attractive formulation. We show that for every Hilbert space 7i, and every frame 
S in Ti. (even if S is merely a Bessel sequence), there is a way of constructing 
the ambient Hilbert space /C in such a way that the operator T has a concrete 
reproducing kernel. 

Finally, we mention that a recent paper |VaWa05| serves as a second motivation 
for our work; in fact [VaWaOSl contains finite-dimensional cases of two of our present 
theorems. These results in |VaWa05j are Theorems 2.9 and 6.4 in that paper: 
The results in jVaWaOS] are concerned with symmetries of tight frames, and with 
associated families of unitary representations of the symmetry groups. It turns out 
that this approach to symmetry is natural in the context of operator theory; see. 



Let 5 be a countable set, finite or infinite, and let 7i be a complex or real 
Hilbert space. We shall be interested in a class of spanning families of vectors 
(v(s)) in Ti. indexed by points s € S. Their properties will be defined precisely 
below, and the families are termed frames. The simplest instance of this is when 
Ti, = P [S) — the Hilbert space of all square-summable sequences, i.e., all /: — > C 
such that X^ses 1/ < that case, set 



e.g., |PaSc72| . |Dut()4a| . |Dut()6| . 



2. Preliminary notions and definitions 



(2.1) 




for aU/1,/2 ^s). 

It is then immediate that the delta functions { (5^ | s G S* } given by 



(2.2) 




form an orthonormal basis (ONB) for Ti, i.e., that 



(2.3) 




and that this is a maximal orthonormal family in Ti.. Moreover, 




It also is immediate from H2.1|l that Parseval's formula 



(2.5) 




ses 



holds for all f (S). 

We shall consider pairs (5, H) and indexed families 

(2.6) {^r{s)\ s e S} CH 
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Figure 2. Two illustrations for n — A 



such that for some c S the identity 

(2.7) Il/ll' = c5]|(v(,s)|/)|^ 

ses 

holds for all f eH. 

When a Hilbert space TC is given, our main result states that solutions to (|2.7|) 
exist if and only if Ti. is isometrically embedded in £^ (S). But we further charac- 
terize these embeddings, and we use this in understanding the geometry of tight 
frames (details below). 

Definition 2.1. Let (S*, Ti, c, (v {s))^^g) be as above. We shall say that this system 
constitutes a tight frame with frame constant c if (|2.7|l holds. 



(Note that if (v {s))g^g satisfies (I2.7|) . then the scaled system (Vcv (s))^^^ 
the property with frame constant one.) 



has 



Example 2.2. {S finite.) Let H be the two-dimensional real Hilbert space, and 
let 71 > 3. Set := {1, 2, . . . , n} S'„, and 

/ 

"OS I - 
V n 

'2tts" 

n 



(2.8) 



v(s) 



27rs\ \ 



V 



s e S. 



Then it is easy to see that this constitutes a tight frame with frame constant c—^. 
Examples are presented in Figures ^ ^^nd |21 
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Definition 2.3. Let Ti, and K be Hilbert spaces over C or M, and let V : Ti, ^ K 
be a linear mapping. We say that V is an isometry, and that Ti is isometrically 
embedded in K (via V) if 

(2.9) WVfW^^WfWn, f^-n. 

Given a linear operator V : 7i — > /C, we then denote the adjoint operator V* : K, ^ 
Ti. It is easy to see that V is isometric \S V*V = In, where lu denotes the iden- 
tity operator in Ti. Moreover, if V is isometric then P = Py = VV* : /C ^ /C is a 
projection, i.e., 

(2.10) p = p* = p^ 
holds, and the subspace 

(2.11) P/C C /C 

may be identified with Ti. via the isometric embedding. 

We state our next result only in the case of frame constant c = 1, but as noted 
it easily generalizes. 

Theorem 2.4. Let S be a countable set, and let Ti. be a Hilbert space over C (or 
M). 

Then the following two conditions are equivalent: 

(i) There is a tight frame {v(s) \ s € S } G Ti. with frame constant c = 1; 

(ii) Ti is isometrically embedded {as a closed subspace) in (S). 

Proof. The details of proof will follow in the next section. □ 

Remark 2.5. Tight frames with frame constant equal to one are called Parseval 
frames. 

3. Proof of Theorem 12.41 

Let the data be as specified in the theorem: A pair (5, Ti) is given where 5' is a 
set and is a Hilbert space. The conclusion is that (jH) the S'-tight-frame property 
for Ti is equivalent to JuJ the (isometric) embedding of Ti into l"^ (S). 

Assume (jij, and let { v (s) | s e S* } C H be the frame system which is asserted. 
Now define 

(3.1) V:Ti3 f^{{^,is)\f)^)^^g. 

This operator is called the analysis operator for the frame. 

Equivalently, the analysis operator V may be written in terms of the canonical 
ONE i6s)^^s for ^ (S) as follows: 

(3.2) y/ = ^(v(s)|/)<5, {ef{S)). 

Our first two observations are that the range of V is contained in i"^ (S) , and that 
V is isometric. But note that both these conclusions are immediate consequences 
of identity H2.7|l for the special case c = 1 . 

We formalize this in the following lemma. (The proof of converse implication in 
Theorem 12 .41 will be resumed after the lemma.) 

Lemma 3.1. Let (v (s))^^^ be a system in the Hilbert space Ti, and let V be defined 
by (|3.1|1 . Then ()2.7|l holds if and only if ^ V is isometric. 
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An easy calculation yields the formula for the adjoint operator: 

(3.3) V'^ac.W) =E^^^(*)' ic.)€f{S). 

ses 

Hence 

(3.4) f = V*Vf = Y,{vis)\f)vis) 

ses 

holds for all f eH. 

Moreover, the projection operator P := VV* is given by the formula 

(3.5) (i^(c.))i = 5](v(0 I v(s))„c,; 

ses 

in other words, P has a concrete matrix representation in the Hilbert space (S). 
Specifically, P is represented as multiplication on column vectors (cs)^^^, and the 
matrix of P is 

(3.6) P(i,5)-(v(t)|v(s))„. 

To prove the converse, assume (juj. Hence, there is an isometry V : H i"^ {S). 
As we noted, this means that P := VV* is a projection in £^ (S), and that 

(3.7) Pf{S) = {Vf\feH}. 

Now observe that v (s) :— P {6s), where Ss for each s € S" is the delta function of 
(E3. We claim that holds for c = 1. To see this, let / e H be given. Then 

\\ff-\\vf\f = EK-^^I^/)!' 

by ESI 



J2\{Ss\PVf] 

ses 

J2\{PSs\Vf] 

ses 



ses 

which is the desired conclusion. □ 

Remark 3.2. Even when no restricting assumptions are placed on a given system 
of vectors (v {s))^^^, the function P from H3.6|l is always positive semidefinite; see 
Definition 15.11 Moreover, the following converse implication holds (Theorem 15.21 
below), known as the reconstruction principle: Every positive semidefinite function 
has the form H3.6|l for some Hilbert space and an associated system of vectors. As 
we show in Section when this is specialized, we find that there is a graduated 
system of frame properties which may or may not hold for a given system of vectors 
(v (s))ggg. Moreover we show that each of these properties reflects a corresponding 
axiom for the associated function H3.6() , Gramian, or correlation matrix. Our results 
in Sections|SlandElbelow serve three purposes: (1) one is to use reproducing kernels 
|Aro50[ I^el57l IPaSc72| and their spectral theory to study classes of frames and their 
symmetries; (2) another (e.g., Theorems l5 . 51 and 16.21) is to use an idea from operator 
theory to establish results about frame deformations and their stability; and finally 
(3) these results serve to tie the operator theory to more current applications. 
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Corollary 3.3. For i = 1,2, consider two systems {Si, Hi) of sets and Hilbert 
spaces, and assume that (vi {si))^.^g, is a pair of tight frames with respective frame 
constants Ci. Then 

(3.8) w(si,S2) := vi (si) (g) V2 (s2) 

defines a tight frame for the tensor-product Hilbert space TLi ® Ti.2 with frame con- 
stant C = C1C2. 

Proof. The result follows immediately from the theorem and Lemma |3.1I To see 
this, note that if Vi, i = 1,2, are the operators defined in (|3.1|) above, then both 

(3.9) ^,V,:n,-^eiS,) 
are isometric embeddings. It then follows that 

(3.10) ^/o[Vl<g) = ^/c^Vi®V2 

is an isometric embedding of Hi (E) 7^2 into £^ (^i x 82)- From the fact that each Vi 
is defined from the system (v, (si))j,.g_g. , it follows readily that the tensor operator 
Vi (8) V2 is defined from the system in H3.8|l . 
Specifically, 

(3.11) w (si, S2) = {Vi (E) V2)* (Ss, E) = Vi*5s, E) V2*Ss^ = vi (si) (g) V2 (S2) , 
which is the desired result. □ 

Definition 3.4. Let (S, H.) be a pair as above: 5 is a set and H. is a. Hilbert space. 
Then the matrix 

(3.12) fc(t,s):=(v(t)|v(s))„, s,teS, 
is called the Gramian, or the Gram matrix. 

Corollary 3.5. Let the pair {S,Ti.) be as in the statement of Theorem 12.41 Let 
{ V (s) I s G S} be a system of vectors in Ti. and let k(t,s) — ( v (t) | v (s) ) be the 
corresponding Gram matrix. Then (v(s))ggg is a tight frame with frame constant 
c if and only if the following two conditions hold: 



(a) k {t, s) — k (s, t) , and 

(b) k (si, t) k {t, S2) = c^^/c (si, S2) for all si, S2 G S. 
tes 

Proof. It is immediate that the stated conditions are equivalent to the matrix P 
in H3.6|l defining a projection when P = cK and K(t,s) := (v(t) | v(s)). As a 
consequence, we see that the two conditions @ and (0 are a restatement of (|2.1(JII . 
i.e., the definition of a projection. (We shall consider only orthogonal projections 
P, i.e., operators P where both of the conditions in (|2.10() are assumed.) □ 

Remark 3.6. As an application, we are now able to verify the assertion in Example 
12.21 First note that the Gram matrix of H2.8|l is 

(3.13) k (Sl, S2) = cos [ ^ —] 1 Si,S2€Sn. 



8 



PALLE E. T. JORGENSEN 



Hence property ijsj) in the corollary is immediate. To verify JbJ, note that 

2^ fc(si,t)fc(i,S2) = 2^ cos I ^ I COS ' ^ ' 

tes„ tes„ ^ 



IE 



, cos , 

2 ^ V V n 

tes„ 



n / \ n 
27r(si -S2)\ , f 2n {si + S2 - 2t) 



n /27r(si - S2)\ _i, , ^ 
2 ''"M ^ l^"" k{si,S2) 



with c—-. 

n 

In the last step, we used the trigonometric formula 

5:cos(--^j^0. 

1=1 ^ ' 

(We refer to Figures to |21 for simple illustrations.) □ 

Corollary 3.7. Let the 'pair (SjTi.) be as in Corollary 13.51 and Theorem 12.41 Sup- 
pose {-v (s) \ s Cz S } is a tight frame in TL with frame constant c. Then every f in 
Ti. has the representation 

(3.14) / = c^(v(s)|/)v(s), 
where the sum converges in the norm of the Hilbert space Ti. 

Proof. In view of the argument in the proof of Corollarv l3.5l we may reduce to the 
case where the frame constant c is one, i.e., c = 1. (In general, the Gram matrix 
K {t,s) = ( V (t) I V (s) satisfies K — c'^P where P is a projection in the Hilbert 
space [S].) The reduction to the case c = 1 means that 

(3.15) V:n3 f^{{w{s)\f))^^,ee{S) 

is isometric. The projection P := VV* is multiplication by the matrix 

((v(t)|v(s)))^,,5. 
Since P is the projection onto the range of V in (|3.15|) we conclude that 

(3.16) (v(OI/)=E(^(^)l^(^))(^(^)l/)' 

where the convergence is in £^ {S). But the vectors { v (t) | t G S*} span a dense 
subspace in 7i, so we get the desired formula 

(3.17) / = ^(v(.)|/)v(.), 

now referring to the norm and the inner product in TL. Recall that on the range of 
V , the respective inner products of Ti and of £^ (5) coincide. □ 

Corollary 3.8. Let the pair {S,Ti) be as in Corollary 13. 7L and suppose that 

{^is)\seS} 
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is a tight frame for H with frame constant c. Further suppose that some S ^ C 
satisfies 

(3.18) / = c^C.v(s), 

ses 

where the sum is convergent in Ti. Then 

(3.19) Ei^^i'^Ek^(^)I/)I'- 

ses ses 

Proof. With the assumptions in the corollary, apply the mapping V from (|3.15f) to 
both sides in (|3.18() . We get the formula 

(3.20) (Fa-((v(t)l/)^)e^'(^). 
Hence 

(3.21) C = PC+{I-P)i 
is an orthogonal decomposition, i.e., 

(3.22) iieii,'. = i|peii'2 + !!(/- p)eii'., 

and the conclusion H3.19(l is immediate. □ 

4. Shannon's example 
In the Hilbert space (M) we will consider the usual Fourier transform 

(4.1) /(0:= / e-'^^'^f{x)dx, 

where convergence is understood in the sense of L^. The familiar interpolation 
formula of Shannon |Ash9r)| applies to band-limited functions, i.e., to functions / 
on M such that the Fourier transform / is of compact support. For the present 
purpose, pick the following normalization 

(4.2) supp I 

and let H denote the subspace in (M) defined by this support condition. In 
particular, H is the range of the projection operator P in (M) defined by 

(4.3) {Pf ){x)--^ l\^^^^'fit)dt. 
Shannon's interpolation formula applies to / G 7i, and it reads: 

(4.4) f{x)^Y.f{n) ^ ^. 

Definitions 4.1. Let C M, and set 

/A r\ / \ / \ , , sin TT (x - s) 

(4.5) V (s) (x) := V (s, x) = , s e S. 

TT [X — Sj 

Hence if we take as index set 5 := Z, then we may observe that the functions on 
the right-hand side in Shannon's formula H4.4f) are v (n) frame vectors, n S Z. We 
shall be interested in other index sets S, so-called sets of sampling points. We shall 





1 


1" 








^2 


2 
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view the functions v (s) as vectors in 7i. The inner product in Ti. will be that which 
is induced from (M), i.e., 



(4.6) (/i I /2) := / h{x)h{x) dx. 

The following is well known but is included as an application of CoroUarv 13.51 
It is also an example of a pair {S, TL) where S is infinite. 

Proposition 4.2. Let S C R be a fixed discrete subgroup, and assume that Z d S . 
Then [s) \ s €z S } is a tight frame in TL if and only if the group index [S : Z) is 
finite, and in that case the frame constant c is c — (S : Z) . For the Gram matrix, 
we have: 

( sin7r(si - sa) ^ o / 

r^, X I 7 ^ for Si,S2e S, sii^ S2, 

(4.7) K{si,S2)=< 7r(si-S2) 

[l ifSi = S2. 

Proof. Formula H4.7|) for the Gram matrix follows from Fourier transform and the 
following computation of the inner products: 

, , „, , / N , , N X f siuTT (x — Si) sinvr ix — S2) , 

(4.8) (v(si) I v(s2))„= / ^ ^dx. 

7r(x-si) 7r(a;-S2) 

A second computation shows that K {31,82) ~ (v(si) | v(s2)) satisfies the two 
conditions and (0 of Corollary 13. 51 i.e., 

(4.9) K{si,S2)^K{s2,si), 
and 

(4.10) ^K{si,t)K{t,S2)^{S:'L)K{si,S2) for aU si, S2 G 5. 

tes 

The argument behind this formula uses the known fact that the functions 

{ V (n) I n € Z } 
in (|4.4|l form an ONB in Ji; in particular, that 

(4.11) (v(ni) I v(n2)).^ = (5„i^„2 forni,n2eZ. 
Since Z, d S, we get the following summation formula: 

Y,K{s^,t)K{t,S2)=J2{v{s,)\^{t))^{v{t)\v{s2))^ 
tes tes 

kes/z nez 

■sr-^ sr-^ siuTT (si — — Tl) sinTT (n — (S2 — fc)) 

^-^ ^-^ 7T(si — k — n) Tr(n—(s2 — k)) 
kes/z nez ^ ^ > \ \ ^ )) 



sinTT (si — S2) 

TT (si — S2) 



E 



= (5:Z)(v(si) I v(s2))^ = (5:Z)if (si,S2), 

which is the desired formula (|4.10(l . The remaining conclusions in the proposition 
now follow immediately from Corollary 13. 51 □ 
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Remark 4.3. The significance of using a larger subgroup S, i.e., Z C 5, in a 
modified version of Shannon's interpolation formula H4.4() is that a larger (discrete) 
group represents " oversampling^^ . However, note that the oversampling changes the 
frame constant. 

As a contrast showing stability, we now recast a result on oversampling from 
jBJMPOS] in the present context. It is for tight frames of wavelet bases in (M), 
and it represents an instance of stability: a case when oversampling leaves invariant 
the frame constant. 

Proposition 4.4. Let ijj ^ L"^ (R), and suppose that the family 

(4.12) Vj,fe(a;) :=2^'/2^/;(2^x-fc), j,keZ, 
is a Parseval frame in L^ (M). Let p G N fee odd, p > 1, and set 

(4.13) ijp{x):^-tp(-], 
and 

(4.14) ^p^,,k{x):=2^/^^p{2^x~k), j, fc G Z. 

Then the "oversampled" family H4.14|l is again a Parseval frame in the Hilbert space 
L2 (R). 

Proof. We refer the reader to the argument in Section 2 of jBJMPOS] . and to 
Example 15.91 below. □ 

5. Symmetries 

A basic fact of Hilbert space is that permutations induce unitary operators. 
By this we mean that a permutation of the vectors in an orthonormal basis for 
a Hilbert space Ti. induces a unitary transformation U in Ti. In this section we 
explore generalizations of this to frames. 

Definition 5.1. Let 5 be a set and let fc: 5' x 5 ^ C be a function. We say that 
k is positive definite, or more precisely positive semidefinite, if the following holds 
for all finite sums: 

(5.1) 5]5]e.6^(s,t)>o. 

ses tes 

While the following result is known, it is not readily available in the literature, 
at least not precisely in the form in which we need it. Thus we include here its 
statement to save readers from having to track it down. 

Theorem 5.2. (Kolmogorov, Parthasarathy-Schmidt |PaSc72j ) 

(a) Let k: 5 x S* — !■ C fee positive definite. Then there are a Hilbert space Ti. and 
vectors { v (s) | s G 5* } C Ti such that 

(5.2) fc(s,i) = (v(s) I v(i))H, s,tGS, 

and Ti. is the closed linear span o/ { v (s) | s G S}. 

(b) Let tt: S ^ S be a bijection. Then 

(5.3) t/, : V (s) ^ V (^ (s)) 

extends to a unitary operator in Ti Ti (fc)) if and only if 

(5.4) k{n{s) ,n{t)) = k{s,t) for all s,t £ S. 
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(c) If X: 5'^T = {zeC| \z\ = 1} and if n is as in (0, then 
(5.5) v(s)^A(s)v(^(s)) 
extends to a unitary operator in TL if and only if 



(5.6) \{s)\{t)k{-K{s) ,TT{t)) = k{s,t) foralls^teS. 

Proof. The reader is referred to |PaSc72| for details. □ 

In fact, there are important appUcations of Theorem 15. 21 to frames with contin- 
uous index set. The best known (also included in |PaSc72j ) is the example when 
V (t) is a Wiener process, i.e., a mathematical realization of Einstein's Brownian 
motion. 

Remark 5.3. As an application of Theorem l5 . 2l|b| . note that in each of the Figures 
n and El the frames are unitarily equivalent as the angle 9 varies. But they are 
inequivalent as n varies from 3 to 4. More generally, turning to Example 12.21 if n 
is fixed and a new system {vg (s)) is defined by translating the argument in (|2.8|) 
by 0, then the assignment v (s) — s- (s) extends to a unitary operator in the two- 
dimensional Hilbert space Ti.. But as n varies, we get families that are not unitarily 
equivalent. In fact, it follows from Remark 13.61 that the examples from Figure 
are not equivalent to those in Figure 12 even when equivalence is defined in the 
less restrictive sense of (|5.5|l in Theorem 15. 2ljr!^ . i.e., allowing a phase factor in the 
transformation of the respective systems of frame vectors. 

For simplicity, return here to the case when the set 5* is assumed countable and 
discrete. 



Definition 5.4. (Following |Nel57l lNei59) .) A closed subspace Ti in ("^ (S) is said 
to be a reproducing kernel subspace if for every s € S, the mapping 

(5.7) H3f^f{s)eC 

is continuous. Note that by Riesz's lemma this means that there is for each s a 
unique element v (s) G 7i such that 

(5.8) /(.)^(v(.s)|/). 
And by Schwarz's inequality we get 

(5.9) 1/(5)1 <||v(5)||„||/||„. 

Theorem 5.5. Let the pair {S,Ti.) be as in the statement of Theorem 12. 4L Specif- 
ically, we assume that there is a tight frame (v(s))^gg for H with frame constant 
c. 

Then it follows that Ti. is a reproducing kernel Hilbert space, and that 

(5.10) |/(s)| < fc(s,s)^/^ 11/11^ for all 8 e S and f en, 
where k(s,t) — (v(s) | v (i) ) is the Gram matrix ofH. 

Proof. Let {S. Ti) be as stated. Then by Corollarv l3.7l we have the representation 



(5.11) / = c^(v(.)|/)v(.), 

ses 

referring to the isometric embedding Ti = — > {S). The Gram matrix of (v (s))3g5 



induces an operator K, and P — cK is the projection of £ (S) onto the subspace 
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H.. Moreover, v (s) = P [5s) for all s ^ S. Now apply both sides of to some 

point t Cz S. Via the isometric embedding, we know that 

(5.12) n = {fee'{s)\pf^f}. 

Hence, iifeH, we get / (t) = {St \ f) = {St \ Pf) = {PSt \ f) = (v(t) | /); and 
by 

(5.13) /(t) = (v(.) I / ) (v(t) | v(.)) . 

"^'^ k(t,s) 

An application of Corollary 13. 51 and of Schwarz for P (S), now yields 

\kit,s)\' 



\f{t)\<c(Y.\(^(')\f)\'] 

Vses / Vses 



1/2 / V 1/2 

2 1 



= \\f\\^k{t,t)'/\ a 

Remark 5.6. It is clear that the converse to the theorem also holds: If H ' — > 

P' {S) is a reproducing kernel Hilbert space, then for each s £ S, and f E H, 
/ (s) = ( V (s) I /)^ holds for a unique family (v (s))^^^ in H. This family will be 
a tight frame with frame constant one. If c e (0, 1), then Wc (s) c'^^^v (s) will 
define a tight frame with frame constant c. 

6. More general frames 

Since the condition H2.7|) which defines tight frames is rather rigid, it is of interest 
to consider how it can be relaxed in a way which still makes it useful. 

As before, we will consider a pair {S,H), where 5 is a fixed countable set, and 
where 7i is a Hilbert space 

Definitions 6.1. A system of vectors (v (s))^^^ in H is called a frame for H if 
there are constants < Ai < ^2 < oo such that 

(6.1) A^Wff <J2\{^{^)\f)\' <A2\\ff forall/GTi. 

ses 

It is called a Bessel sequence if only the estimate on the right-hand side in (|6.1|) 
is assumed, i.e., if for some finite constant A, 

(6.2) forall/GH. 

Recall that when H6.2|l is assumed, then the analysis operator V — V(v(s)) given 

by 

(6.3) 7i9/K^((v(s)|/)),,^e^2(5) 

is well defined and bounded. Hence, the adjoint operator V* : i"^ {S) ^ H is 
bounded as well, and 

(6.4) V* (6) = E ^« ^ (■^) (^«) ^ (^) ' 

ses 

where the sum on the right-hand side in H6.4|) is convergent in H for all (^s) G i'^ {S). 
The tight frames for which Ai = A2 = 1 are called Parseval frames. 
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Theorem 6.2. Let (5, 7i) be as above, and let {"v{s))^^g be a Bessel sequence with 
Bessel constant A. 

(a) Then the closed span Tii^ of (v (s))^^^ contains a derived Parseval frame. 

(b) The derived Parseval frame is a Parseval frame for Ti. if and only z/(v {s))^^g 
is a frame for H, i.e., iff Tim — Ti,. 

(c) In the general case when (v {s))^^g is a Bessel sequence, the operator W :— 

V {V*V) is well defined and isometric on Tiin, and 

(6.5) w(s) (y*y)"^/^v(s), se5, 

is a Parseval frame in Tim . 

Proof. It is easy to see that both V and V* are bounded; V is everywhere defined 
on H, and V* everywhere defined on (S). For the operator norms, we have 
||y|| = \\V*\\ = \\V*V\\^^^ < The initial space oiV,n{V), is defined as 

(6.6) ne{f en\vf ^o} = R(v^, 

where the over-bar stands for norm-closure in H, and where R{V*) denotes the 
range of V* . 

We let Hin denote the closed span of the given Bessel sequence (v (s))^^^. Our 
claim is that 

(6.7) Hin ^n{v). 

To see this, note that (16.41) implies the inclusion (3) in H6.7|l . But all finite linear 
combinations X^s ^ ^'^'^ contained in R{V*), and by closure, we get Tiin Q 
i?(y*), which is the second inclusion in 16.7|l . Hence (|6.7() holds. 

We now apply the polar decomposition (from operator theory), see |KaHi97| . to 
the operator V . The conclusion is that there is a partial isometric W such that 

(6.8) V ^ W {V*Vf''^ ^ {VV*f''^ W 

and such that the initial space of W is Ti^^ and the final space of is i? [V) . 
Implied in this are the following assertions: 

(i) Both of the operators W*W and WW* are projections; 

(ii) The range of W*W is Hin, 

(iii) The range of WW* is R{V)] 

1/2 

(iv) The operator V*V is selfadjoint, and {V*V) ' is defined by the spectral 
theorem applied to V*V . 

Now apply Theorem 15. 51 to the restriction operator 

(6.9) W-.Hin — >i^(S). 

In view of ^ above, this is an isometry. Recall W*WTi — Hin by 16.7(1 and the 
polar decomposition H6.8|l . As a result, we get that the vectors w (s) = W*Ss, 
for s G S, form a Parseval frame for Hin- But we also have the formula V*6s — 
V (s) as an application of 1(6.4(1 . Using now the two facts 1(6.9(1 and ((6.8(1 . we get 
w(s) = W*Ss = {V*Vr'^^^V*Ss = (y*F)"^/^v(s), which is the desired formula 
((6.5(1 from the conclusion in the theorem. The remaining conclusions stated in the 
theorem are already implied by the reasoning above. □ 
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Remark 6.3. The operators V*V and VV*. Except for the point A = 0, the 
two operators V*V and VV* have the same spectrum. But in the general case, this 
spectrum could be discrete or continuous; or it could even be singular. 

The fact that the spectrum minus {0} is the same follows from ()6.8|l . In the frame 
case, it follows from H6.1|l that the spectrum is contained in the interval [yli,^2]- 
But if (v is))g^g is only a Bessel sequence, H6.2|l . the best that can be said is that 
the spectrum is contained in [0, A]. In fact, the lower bound in spectrum is 
also the best lower frame bound, referring to l|6.1|l . 

Computationally, however, the two operators V*V and VV* are quite different. 
The first one operates in H, while the second one maps £^ (S) into itself. 

The formula 

(6.10) V*Vf = Y,{vis)\f)v{s) for fen 

ses 

shows that V*V serves to decompose vectors in H relative to the given frame 
(v (s))jgg. In contrast, VV* has an explicit matrix representation: 

Proposition 6.4. Relative to the ONB {5s)g^s' ^■s simply multiplication with 

the Gram matrix 

(6.11) ((v(.)|v(i))„)^,^^. 

Proof. To compute the (s,t)-matrix entry for the matrix which represents the op- 
erator VV* , we use the inner product in P {S) as follows: The (s,t)-matrix entry 
is 

(6.12) ( 5, I VV*5t = ( V*5s I )^ = ( V (s) I V (t) , 

which is the Gram matrix. □ 

Example 6.5. Example 12 . 21 revisited for n. — 3. 

In the case of Example 12. 21 (see also Fig. ^| for n — 3, VV* is the 3x3 matrix 

1 -i 

_i _ 1 

2 2 



while V*V may be represented as 



^ 

2 " 

^ 

" 2 



i.e., a 2 X 2 matrix. Moreover, spec {VV*) = {O, §}, and spec {V*V) = {§}• 
Corollary 6.6. Consider a system (7i, S*, (v (s))^^^) as above, and let 

he the associated analysis operator. Then the respective lower and upper frame 
estimates (|6.1|) are equivalent to 

(6.13) spec ((( V (s) I V (i) ))) \ {0} C [Ai, ^2] , 

where (( v (s) | v (t) ))^ is the Gram matrix in (|6.11|l . 
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Proof. Since we noted in licniark 16. 31 that 

(6.14) spec (y*V) \ {0} = spec (VV*) \ {0} , 

the assertion in H6.13|l foUows immediately from Proposition 16.41 SpecificaUy, the 
two estimates in (|6.1|) are equivalent to the following system of operator inequalities: 

(6.15) AiIh ^ V*V ^ A2IH, 

where the ordering in H6.15(l refers to the familiar ordering on the set of self- 
adjoint operators 'KaR.i97j . Now an application of the spectral theorem jKaR,i97| 
to V*V shows that H6.15|l is also equivalent to the set-containment spec(y*y) C 
[^1,^2]- In fact, the lower estimate in l|6.1|) holds iff s^ec{V*V) ^ [Ai,oo), while 
the upper estimate is equivalent to the containment spec{V*V) ^ [0,v42]- D 

While CoroUarv 16.61 is rather abstract, it has a variety of specific uses which 
serve to make it clear how certain initial frame systems are transformed into more 
detailed frames having additional structure. A case in point is the transformation 
of frames used in the analysis of signals into frequency bands, for example mutually 
non-interfering low-pass and high-pass bands. A convenient tool for accomplish- 
ing this is the discrete wavelet transform. As noted in, for example, |Chr03| and 
|.] or06j ■ the discrete wavelet transform serves to create nested families of resolu- 
tion subspaces (details below) in the Hilbert spaces of sequences which are used in 
our representation of time-series, or of speech signals. When more sub-bands are 
introduced, this same idea works for the analysis of images. 

By a discrete wavelet transform with perfect reconstruction we shall mean (fol- 
lowing |Jor06j ) a Hilbert space Ti and a system of operators i^o , Fi vaTi such that 

1 

(6.16) F,F*^S,^jI, yF*F,^I, and F^f^O for aU / G 

i=0 

As further noted in |Jor06| . each system of quadrature mirror filters from stan- 
dard signal processing defines an operator system (Fi) as in (|6.16|l . 

Remarks 6.7. Q The subscript convention for the two operators Fq and Fi in 
()6.16|l comes from engineering. The index value i = corresponds to a chosen 
low-pass filter followed by downsampling, while Fi is the operation of a high-pass 
filtering followed by downsampling. Hence "low" is indexed by zero. This index 
convention is not related to that of the two frame bounds Ai in (|6.1(l . These two 
numbers are usually called Ai and A2. 

(0 [Referring to the sum-formula in (|6.16|) .] In stating our quadrature condi- 
tions (|6.16l) we have for reasons of clarity restricted attention to the simplest case: 
dyadic and orthogonal filters. (The dyadic case refers to the dyadic wavelets from 
Proposition l4 . 41 above . ) But our present discussion (both in Sections^andEJ easily 
generalizes to systems with more than two bands, and even to less restrictive quad- 
rature conditions. In case of more, say N bands, the indexing of the operators Fi 
is i = 0, 1, . . . , iV — 1. And instead of using the operator F* in the sum in H6.16|) at 
the i'th place, we may for some applications rather use a second operator Gi (not 
equal to F*); see for example poKr0 3 for details on these more general systems. 

Corollary 6.8. Let (v (s))^gg be a frame with frame bounds Ai, i — 1,2, in a 
Hilbert space Ti, and let {Fi) be a discrete wavelet transform system {as in ()6.16|l ^. 
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Set 

(6.17) v(fc,s) :=i^o*'=Fi*v(s), s G 5, fc 0, 1, 2, . . . . 

Then the subdivided vector system (v (/c, s)) is a frame in Ti. with the same frame 
bounds Ai as (v (s)). Moreover the Gramian of (v (fc, s)) /las t/ie /orm I ®G where 
I is the {infinite) identity matrix, and G is the Gramian for (v (s)). 

Moreover, if two frames (v (s)) and (v' (s)) ore unitarily equivalent in the sense 
of Theorem 15.21 f/ien iwo refined systems (v(A;,s)) and (v'(/c,s)) resulting from 
(|6.17|l are a^so unitarily equivalent. 

Proof. Since in general, by Corollary 16. 61 the two frame bounds (upper and lower) 
coincide with the spectral bounds for the corresponding Gramian, we only need to 
study the Gramian of the new system (v (fc, s)) in H6.17|l . Recall that the Gramian 
for the new system is the matrix of inner products, with the only modification to 
the formula in Theorem 15. 51 being that the row and column indices are now double 
indices. 

The significance of the third condition from 16.16|l is related to the kind of 
subspace structure in 71 which models resolutions of signals. Since FqFq = I, we 
get a nested system of projections 

(6.18) Pfe:=F*^i^o^ A: = 0,1,..., 
and 

(6.19) ■■■Pk+i<Pk<--<Pi<Po=I- 

Recall that the ordering of projections coincides with the associated ordering of the 
range subspaces Hk ■= Pk'H in Ti, i.e., 

(6.20) •••Hfc+i CHfe C ... C C7i. 

The third condition in H6.16|l is equivalent to the assertion that 

(6.21) fl nk = {o}. 

fee{o,i,... } 

Specifically, 

(6.22) ( V (j, .) I V (fc, t) ) = ( F; ^ F* V (s) I F* ^ F* v (t) ) = 5,,k ( v (.) | v (t) ) . 

Since the last expression is the tensor product of / with G, the result follows. 

The last part of the conclusion in the corollary about preservation of unitary 
equivalence in passing to the refinement (v (s)) (v (fc, s)) follows from this and 
Theorem O □ 

Example 6.9. (Following the terminology from (|4.12() in Proposition l4.4l ') Suppose 
some dyadic wavelet {ipj^k) comes from a scaling function Lp. Set S :— Z, and 

(6.23) w [k) := if [x - k) , k e 1. 

Then there are known conditions on such a scaling function if for the frame esti- 
mates (|6.1|) to hold; see, e.g., |CoDa93j . To apply the operator system (|6.16f) from 
above, choose the Hilbert space Ti be the closed subspace in (M) spanned by 
the integral translates {ip {x — k) \ k G Z}. Following |,Tor06j and H6.17|l above, we 
may then construct operators Fq, Fi and introduce the associated resolution frame 
(v (j, fc)), double-indexed as in CoroUarv 16.81 as follows: 
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Set 

(6.24) V (j, k) F*^ F* v (k) = ^J-j-im for j = 0, 1, 2, ... , and fc e Z. 

Using the corollary, we then conclude that for each j, the functions { v (j, A;) | fc G Z } 
generate the relative complement subspace Tij QHj+i from the nested resolution 
system wc introduced there. By this we mean that for each j, Hj Q Wj+i is the 
closed linear span of { v (j, A;) | k G Z }. 
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